Augmented reality screen system and augmented reality screen display method

ABSTRACT

An augmented reality screen system includes an augmented reality device and a host. The augmented reality device is configured to take a physical mark through a camera. The host is configured to receive the physical mark, determine position information and rotation information of the physical mark, and fetch a virtual image from a storage device through a processor of the host. The processor transmits an adjusted virtual image to the augmented reality device according to the position information and the rotation information, and the augmentation device projects the adjusted virtual image to a display of the augmented reality device. The adjusted virtual image becomes a virtual extended screen, and the virtual extended screen and the physical mark are simultaneously displayed on the display of the augmented reality device.

CROSS REFERENCE TO RELATED APPLICATIONS

This application claims priority of Taiwan Patent Application No.109127010, filed on Aug. 10, 2020, the entirety of which is incorporatedby reference herein.

BACKGROUND OF THE INVENTION Field of the Invention

The present disclosure relates to augmented reality application, inparticular, to an augmented reality screen and an augmented realityscreen display method.

Description of the Related Art

At present, extended screens have been widely used in work and dailylife. For example, a user can use two screens to expand more windows.However, if users want multiple screens, they need to buy thecorresponding number of screens. For example, if a user needs threescreens, three screens must be purchased. The more screens, the higherthe cost. In addition, the user needs to manually adjust the placementof a screen during the process of configuring the screen.

Therefore, how to conveniently use an extended screen so that the usercan see a wider display range has become one of the problems to besolved in this field.

BRIEF SUMMARY OF THE INVENTION

In accordance with one feature of the present invention, the presentdisclosure provides an augmented reality screen system. The augmentedreality screen system includes an augmented reality device and a host.The augmented reality device is configured to take a physical markthrough a camera. The host is configured to receive the physical mark,determine position information and rotation information of the physicalmark, and fetch a virtual image from a storage device through aprocessor of the host. The processor transmits an adjusted virtual imageto the augmented reality device according to the position informationand the rotation information, and the augmentation device projects theadjusted virtual image to a display of the augmented reality device, theadjusted virtual image becomes a virtual extended screen, and thevirtual extended screen and the physical mark are simultaneouslydisplayed on the display of the augmented reality device.

In accordance with one feature of the present invention, the presentdisclosure provides an augmented reality screen display method. Theaugmented reality screen display method includes taking a physical markthrough a camera of an augmented reality device; receiving the physicalmark; determining position information and rotation information of thephysical mark; and fetching a virtual image from a storage devicethrough a processor of a host; wherein the processor transmits anadjusted virtual image to the augmented reality device according to theposition information and the rotation information, and the augmentationdevice projects the adjusted virtual image to a display of the augmentedreality device, the adjusted virtual image becomes a virtual extendedscreen, and the virtual extended screen and the physical mark aresimultaneously displayed on the display of the augmented reality device.

With the augmented reality screen system and the augmented realityscreen display method of the present application, the augmented realitydevice can scan the physical mark placed at any place or any angle, andthe user wearing the augmented reality device can see the virtualextended screen based on the physical mark. The screen size of thevirtual extended screen can be adjusted according to the user'srequirements, which solves the problems of weight, volume, fixed screensize, space limitation, and inconvenience of portability caused by theuse of a physical screen. Therefore, the virtualized display of theextended screen in the augmented reality device can not only replace thephysical extended screen, but also create new usage scenarios.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to describe the manner in which the above-recited and otheradvantages and features of the disclosure can be obtained, a moreparticular description of the principles briefly described above will berendered by reference to specific examples thereof which are illustratedin the appended drawings. Understanding that these drawings depict onlyexample aspects of the disclosure and are not therefore to be consideredto be limiting of its scope, the principles herein are described andexplained with additional specificity and detail through the use of theaccompanying drawings in which:

FIG. 1 is a block diagram of an augmented reality screen system inaccordance with one embodiment of the present disclosure.

FIG. 2 is a block diagram of an augmented reality screen system inaccordance with one embodiment of the present disclosure.

FIG. 3 is a schematic diagram of an augmented reality screen displaymethod in accordance with one embodiment of the present disclosure.

FIGS. 4A to 4C are schematic diagrams of adjusting the field-of-viewrange in accordance with one embodiment of the present disclosure.

FIG. 5 is a schematic diagram of a virtual extended screen of thehead-mounted display device in accordance with one embodiment of thepresent disclosure.

FIG. 6 is a schematic diagram of the application of a virtual extendedscreen in accordance with one embodiment of the present disclosure.

DETAILED DESCRIPTION OF THE INVENTION

The following description is of the best-contemplated mode of carryingout the invention. This description is made for the purpose ofillustrating the general principles of the invention and should not betaken in a limiting sense. The scope of the invention is best determinedby reference to the appended claims.

The present invention will be described with respect to particularembodiments and with reference to certain drawings, but the invention isnot limited thereto and is only limited by the claims. It will befurther understood that the terms “comprises,” “comprising,” “includes”and/or “including,” when used herein, specify the presence of statedfeatures, integers, steps, operations, elements, and/or components, butdo not preclude the presence or addition of one or more other features,integers, steps, operations, elements, components, and/or groupsthereof.

Use of ordinal terms such as “first”, “second”, “third”, etc., in theclaims to modify a claim element does not by itself connote anypriority, precedence, or order of one claim element over another or thetemporal order in which acts of a method are performed, but are usedmerely as labels to distinguish one claim element having a certain namefrom another element having the same name (but for use of the ordinalterm) to distinguish the claim elements.

Refer to FIGS. 1-3, FIG. 1 is a block diagram of an augmented realityscreen system 100 in accordance with one embodiment of the presentdisclosure. FIG. 2 is a flowchart of an augmented reality screen displaymethod 200 in accordance with one embodiment of the present disclosure.FIG. 3 is a schematic diagram of an augmented reality screen displaymethod 200 in accordance with one embodiment of the present disclosure.

As shown in FIG. 1, the augmented reality screen system 100 includes ahead-mounted display device HMD and a host SR. In one embodiment, thehost SR and the head-mounted display device HMD can establish acommunication link through a wired or wireless method.

In one embodiment, the augmented reality device may be a head-mounteddisplay device HMD or other devices that can simultaneously displayvirtual images and physical images. For convenience of description, thehead-mounted display device HMD is taken as an example for description.

In one embodiment, the host SR can be a notebook computer, a desktopcomputer, or other electronic devices with computing functions.

In one embodiment, the host SR includes the processor 10. In oneembodiment, the processor 10 can be implemented by using an integratedcircuit, such as a microcontroller, a microprocessor, a digital signalprocessor, an application specific integrated circuit (ASIC), or a logiccircuit.

In one embodiment, the host SR can include a display PM or an externaldisplay PM. In one embodiment, the display PM is a physical displaycoupled to the host SR.

In one embodiment, the host SR includes a storage device ST. The storagedevice ST can be implemented as a read-only memory, a flash memory, afloppy disk, a hard disk, a compact disk, a flash drive, a tape, anetwork accessible database, or as a storage medium that can be easilyconsidered by those skilled in the art to have the same function.

In one embodiment, the user USR can wear a head-mounted display deviceHMD.

The head-mounted display device HMD includes a camera CAM, a gyroscopeGYR, an infrared receiver IRR and a display HDP. The gyroscope GYR canobtain the field of view and direction of the user's USR wearing ahead-mounted display device HMD by measuring the angular velocity of theaction such as deflection and tilt.

In one embodiment, the camera CAM of the head-mounted display device HMDis used to photograph and track the physical mark MK.

In one embodiment, the physical marker MK can be any form of marker, forexample, a binary square marker (ArUco marker), a QR code, an infraredor a screen outward appearance.

In one embodiment, when the augmented reality screen system 100 presetsthe physical mark MK to be a QR code and the camera CAM captures the QRcode, the camera CAM transmits the captured image and the value measuredby the gyroscope GYR to the processor 10 of the host SR.

In one embodiment, when the augmented reality screen system 100 presetsthe physical mark MK to be infrared and the infrared receiver IRRreceives the infrared, the infrared receiver IRR transmits the imagecaptured by the camera CAM and the measured value by the gyroscope GYRat this time to the processor 10 of the host SR. It can be seen thatthrough the camera CAM or the infrared receiver IRR, the head-mounteddisplay device HMD can capture the physical mark MK. However, theinvention is not limited thereto, as long as the head-mounted displaydevice HMD knows that the physical mark MK has been photographed can beapplied.

Please also refer to FIGS. 2 to 3, and the following describes the flowof the augmented reality screen display method 200. The augmentedreality screen display method 200 can be implemented by using thecomponents in FIG. 1. In one embodiment, as shown in FIG. 3, the goal isto allow the user USR to see the virtual extended screen VIM displayednext to the display PM (the physical display of the host SR) through thehead-mounted display device HMD.

In step 210, a camera CAM of a head-mounted display device HMD capturesa physical mark MK.

In one embodiment, when a camera CAM of the head-mounted display deviceHMD captures the physical mark MK, the captured image CAF and the valuemeasured by the gyroscope GYR are transmitted to the processor 10 of thehost SR (that is, the step S2 the FIG. 3). In one embodiment, the frameCAF captured by a camera CAM is a two-dimensional image, and thetwo-dimensional image includes at least a physical mark MK, in thisexample, the two-dimensional image also includes the image of a displayPM (physical display).

In one embodiment, the host SR can always execute software, such as gamesoftware, but does not display the game screen on the display PM(physical display). The game image is temporarily stored in the storagedevice ST (the storage device here uses memory as an example), and thedisplay PM can be used to display text editing software. After theprocessor 10 receives the physical mark MK captured by the head-mounteddisplay device HMD, it retrieves the game image VIM from the memory(i.e., the step S1 in the FIG. 3).

In one embodiment, the processor 10 can retrieve the game image VIM fromthe memory at regular intervals (for example, every 5 seconds).Therefore, There is no sequence between step 1 and step 2 in FIG. 3.

In step 220, a host SR receives the physical mark MK, determinesposition information and rotation information of the physical mark MK,and retrieves a virtual image VIM from a storage device ST through aprocessor 10 of the host SR.

In one embodiment, the processor 20 of the host SR receives the frameCAF captured by the camera CAM is a two-dimensional image, and therebyextracts the physical mark MK from the two-dimensional image. Theprocessor 20 analyzes the position information and rotation informationof the physical mark MK.

In one embodiment, the position information can be a three-axiscoordinates (ax, ay, az) relative to the head-mounted display deviceHMD, and the rotation information can be a three-axis rotation angle(rx, ry, rz).

In one embodiment, the processor 10 executes a tracking algorithm todetect the position information and rotation information of the physicalmarker MK. The tracking algorithm can be a known marker tracking method,Visual-Inertial Odometry (VIO) algorithm, Simultaneous Localization andMapping (SLAM) algorithm or object tracking algorithm to track theposition information and the rotation information of the entity markerMK.

In step 230, the processor 10 adjusts the virtual image VIM according tothe position information and the rotation information and transmits theadjusted virtual image VIM to the head-mounted display device HMD. Thehead-mounted display device HMD projects the adjusted virtual image VIM′onto a display HDP of the head-mounted display device HMD, so that theadjusted virtual image VIM′ becomes a virtual extended screen. Thevirtual extended screen VIM′ and the physical mark MK are simultaneouslydisplayed on the display HDP of the head-mounted display device HMD.

In one embodiment, since the frame CAF captured by the camera CAM is athree-dimensional image, the physical mark MK extracted from the frameCAF is also a three-dimensional image (shown in the S3 of FIG. 3) andthe processor 10 retrieves and calculates the virtual image VIM from thememory is a two-dimensional image, so it is necessary to perform thecorrection processing of the two-dimensional image projected to thethree-dimensional image, so that the display HDP of the head mounteddisplay device HMD can correctly display the adjusted virtual image VIM′(such as shown in the S4 of FIG. 3). When the user USR sees both thevirtual image VIM′ and the display PM (physical display) through thedisplay HDP of the head-mounted display device HMD, the user USR willvisually treat the virtual image VIM′ as a virtual extended screen (suchas shown in the S5 of FIG. 3).

In one embodiment, the processor 10 calculates target coordinates ofeach pixel of the virtual image VIM projected to the display HDP of thehead-mounted display device HMD through the position projectionalgorithm, to adjust the virtual image VIM. The processor 10 transmitsthe adjusted virtual image VIM′ to the head-mounted display device HMD,so that the head-mounted display device HMD projects the adjustedvirtual image VIM′ onto the display HDP of the head-mounted displaydevice HMD.

The following is a method of adjusting the virtual image VIM so that theadjusted virtual image VIM′ can be projected to the display HDP of thehead-mounted display device HMD. However, the following method is onlyan example, and other known conversion methods can also be applied.

In one embodiment, the processor 10 reads the physical mark MKinformation from the head-mounted display device HMD. The physical markMK information includes position information (ax, ay, az) and rotationinformation (rx, ry, rz). The processor 10 also receives the image dataof the camera CAM, and each pixel is represented by (cx, cu, cz). Inaddition, the processor 10 obtains the physical mark MK information(position information and rotation information) according to thetracking algorithm, and simultaneously captures the virtual image VIM inthe memory.

$\begin{bmatrix}x_{calib} \\y_{calib} \\z_{calib} \\1\end{bmatrix} = {\begin{bmatrix}\; & \; & \; & D_{x - {axis}} \\\; & M_{Rotate} & \; & D_{y - {axis}} \\\; & \; & \; & D_{z - {{ax}is}} \\0 & 0 & 0 & 1\end{bmatrix}\begin{bmatrix}{cx} \\{cy} \\{cz} \\1\end{bmatrix}}$

In one embodiment, the processor 10 calibrates the physical mark MKcaptured by the camera CAM with the projector inside the head-mounteddisplay device HMD as the origin, so as to obtain the relativecoordinates with the projector of the head mounted display device HMD asthe origin. The calibration function is as follows:

Calibration:

The symbol M_(Rotate) is the relative rotation matrix between the cameraCAM and the projector of the head-mounted display device HMD. Thesymbols D_(x-axis), D_(y-axis) and D_(z-axis) are the three-axisposition of the relative translation of the camera CAM and the projectorof the head-mounted display device HMD (the origin of the camera CAM isset to the projector of the head-mounted display device HMD as a neworigin).

In one embodiment, the processor 10 substitutes the calibrated dataXcalib, Ycalib, and Zcalib into a homography matrix for calculation. Thehomography matrix is a concept in projective geometry, also known asprojective transformation. The homography matrix maps a point on aprojective plane to another projective plane, and maps a straight lineto a straight line, which has line-preserving properties. The homographymatrix function is as follows:

${{Homography}{\text{:}\begin{bmatrix}x_{Texture} \\y_{Te{xture}} \\1\end{bmatrix}}} = {{Homography}\left( \begin{bmatrix}x_{calib} \\y_{calib} \\z_{calib} \\1\end{bmatrix} \right)}$

In this way, the coordinate data after the projective transformation canbe obtained.

In one embodiment, the display HDP can be realized by a projector, andthe projector is a display used as a companion display in AR world.

In one embodiment, since the field of view (FOV) and resolution of thecamera CAM are different from the field of view and resolution of thedisplay HDP (or projector) in the head-mounted display device HMD, thefollowing calculation (cropping FOV range and resizing resolution) forfinal imaging position adjustment:

${{Crop}\mspace{14mu}{and}\mspace{14mu}{Resize}{\text{:}\mspace{11mu}\begin{bmatrix}x_{prof} \\y_{prof} \\1\end{bmatrix}}} = {\quad{{{{\left\lbrack \begin{matrix}{W_{des}\text{/}W_{{proj},{cam}}} & 0 & 0 \\0 & {H_{des}\text{/}H_{{proj},{cam}}} & 0 \\0 & 0 & 1\end{matrix} \right\rbrack\left\lbrack \begin{matrix}1 & 0 & W_{offset} \\0 & 1 & H_{offset} \\0 & 0 & 1\end{matrix} \right\rbrack}\begin{bmatrix}x_{Texture} \\y_{Te{xture}} \\1\end{bmatrix}}{wherein}},\begin{matrix}{W_{offset} = {- \frac{W_{cam} - W_{{proj},{cam}}}{2}}} & {W_{{proj},{cam}} = {W_{cam}*\left( \frac{{FOV}_{proj}}{{FOV}_{cam}} \right)}} \\{H_{offset} = {- \frac{H_{cam} - H_{{proj},{cam}}}{2}}} & {H_{{proj},{cam}} = {H_{cam}*\left( \frac{{FOV}_{proj}}{{FOV}_{cam}} \right)}}\end{matrix}}}$

The symbols W_(cam) and H_(cam) are respectively the resolution of thewidth and height of the camera CAM. The symbols W_(des) and H_(des) arethe resolutions of the width and height of the virtual screen VIM′(i.e., virtual extended screen), respectively. In one embodiment, theprocessor 10 displays the calculated virtual extended screen position(dx, dy) on the display HDP of the head-mounted display device HMD. Inthe augmented reality, the user can see the virtual extended screen withthe same rotation angle as the physical marker MK. The processor 10performs crop and resize matrix operations on the position (dx, dy) ofthe virtual extended screen to cut and adjust the size of the virtualextended screen.

Please refer to FIGS. 4A to 4C, 5, and 6, and FIGS. 4A to 4C areschematic diagrams of adjusting the field-of-view range in accordancewith one embodiment of the present disclosure. FIG. 5 is a schematicdiagram of a virtual extended screen of the head-mounted display deviceHMD in accordance with one embodiment of the present disclosure. FIG. 6is a schematic diagram of the application of a virtual extended screenin accordance with one embodiment of the present disclosure.

In one embodiment, as shown in FIG. 4A, the processor 10 captures anfield-of-view range FOV0 in the frame CAF captured by the camera CAM,selects a reference point R0 from the field-of-view range FOV0, andmoves the reference point R0 to a boundary in the frame CAF (forexample, in FIG. 4B, the reference point R0 is moved to overlap with theboundary R1, at this time the reference point is regarded as R1 and thefield-of-view range is regarded as FOV1).

Next, the processor 10 captures a first specific range of thefield-of-view range FOV1 located in the frame CAF (for example, thefirst specific range FOV2 located in the frame CAF, at this time thedesignated reference point is R2). The processor 10 enlarges the firstspecific range FOV2 to be consistent with the resolution of a physicaldisplay PM coupled to the host SR (as shown in 4C, the first specificrange FOV2 is enlarged to the state of the virtual screen FOV3, so thatthe resolution of the first specific range FOV2 is consistent with theresolution of the physical display PM. At this time, the designatedreference point is shifted from R2 to the position of R2′). Theprocessor 10 moves the reference point R2′ to target coordinates R3 onthe display HDP of the head-mounted display device HMD (according to theaforementioned position projection algorithm, the processor 10 cancalculate the reference point R0 of the camera CAM corresponding to thetarget position R3 of the display HDP, and move the reference point R2′to the target coordinates R3) at the time. The processor 10 captures asecond specific range FOV4 of the field-of-view range located in thevirtual frame FOV3, and matches a designated pixel P1 (for example,designated upper left pixel P1) of the second specific range FOV4 to adesignated position of the physical mark MK (designated position, suchas designated upper left pixel P1′ of MK, overlapping designated pixelP1 and designated position P1′), so that the second specific range FOV4of frame CAF becomes a virtual extended screen (that is, the adjustedvirtual screen VIM′). The virtual extended screen VIM′ and the physicalmark MK are simultaneously displayed on the display HDP of thehead-mounted display device HMD.

In one embodiment, the position of the designated pixel P1 of the secondspecific range FOV4 and the designated position P1′ of the physical markMK may be defined in advance.

In one embodiment, when the head-mounted display device HMD does notcapture the physical mark MK temporarily (for example, within 5seconds), the virtual extended screen VIM′ can be displayed on thedisplay HDP of the head-mounted display device HMD (for example,temporarily display for 3 seconds).

In one embodiment, the processor 10 adjusts the second specific rangeFOV4 according to the position information and the rotation information,and regards the adjusted second specific range FOV4 as the virtualextended screen VIM′. The processor 10 knows an extension direction fromthe physical mark MK (for example, in FIG. 5, the physical mark MK islocated on the right side of the physical display PM, and the virtualextended screen VIM′ extends to the right side). The processor 10transmits the extension direction to the head-mounted display deviceHMD, and the head-mounted display device HMD displays the virtualextended screen VIM′ on the display HDP according to the physical markMK and the extension direction, so that the virtual extended screen VIM′and the physical display PM are displayed side by side.

In one embodiment, the size and resolution of the virtual extendedscreen VIM′ and the physical display PM are the same, and the virtualextended screen VIM′ can dynamically display different images.

In one embodiment, the processor 10 crops a field-of-view range FOV0from the virtual image VIM. And, the processor 10 adjusts thefield-of-view range FOV0 to be consistent with the size and resolutionof the physical display PM. The processor 10 then regards the adjustedfield-of-view range FOV0 as the virtual extended screen VIM′, andtransmits the virtual extended screen VIM′ to the head-mounted displaydevice HMD. The head-mounted display device HMD displays the virtualextended screen VIM′ on the display HDP according to the physical markMK and the extension direction, so that the virtual extended screen VIM′and the physical display PM are displayed side by side.

As shown in FIG. 6, through the augmented reality screen display method200, as long as the camera CAM of the head-mounted display device HMDcaptures the physical mark MK, the head-mounted display device HMDtransmits the image containing the physical mark MK to the host SR. Thehost SR can receive the physical mark MK, and the physical mark MKgenerates a virtual extended screen VIM′, and transmits the virtualextended screen VIM′ to the display HDP of the head-mounted displaydevice HMD. The user USR can see the physical mark MK through thedisplay HDP and extend the virtual screen VIM′. In one embodiment, asshown in FIG. 6, the user USR can see multiple physical marks MK and avirtual extended screen VIM′ corresponding to each physical mark MK bythe display HDP. Thus, the virtual extended screens VIM′ can be seen onthe desktop, wall, and next to the physical display PM.

With the augmented reality screen system and the augmented realityscreen display method of the present application, the augmented realitydevice can scan the physical mark placed at any place or any angle, andthe user wearing the augmented reality device can see the virtualextended screen based on the physical mark. The screen size of thevirtual extended screen can be adjusted according to the user'srequirement, which solves the problems of weight, volume, fixed screensize, space limitation, and inconvenience of portability caused by theuse of a physical screen. Therefore, the virtualized display of theextended screen in the augmented reality device can not only replace thephysical extended screen, but also create new usage scenarios.

The method of the present invention, or a specific type or part thereof,can exist in the form of code. The code can be contained in physicalmedia, such as floppy disks, CD-ROMs, hard disks, or any othermachine-readable (such as computer-readable) storage media, or computerprogram products that are not limited to external forms. Among them,when the program code is loaded and executed by a machine, such as acomputer, the machine becomes a device for participating in the presentapplication. The code can also be transmitted through some transmissionmedia, such as wire or cable, optical fiber, or any transmission type.When the code is received, loaded and executed by a machine, such as acomputer, the machine becomes used to participate in this inventeddevice. When implemented in a general-purpose processing unit, theprogram code combined with the processing unit provides a unique devicethat operates similar to the application of specific logic circuits.

Although the invention has been illustrated and described with respectto one or more implementations, equivalent alterations and modificationswill occur or be known to others skilled in the art upon the reading andunderstanding of this specification and the annexed drawings. Inaddition, while a particular feature of the invention may have beendisclosed with respect to only one of several implementations, such afeature may be combined with one or more other features of the otherimplementations as may be desired and advantageous for any given orparticular application.

What is claimed is:
 1. An augmented reality screen system, comprising:an augmented reality device, configured to take a physical mark througha camera; and a host, configured to receive the physical mark, determineposition information and rotation information of the physical mark, andfetch a virtual image from a storage device through a processor of thehost; wherein the processor transmits an adjusted virtual image to theaugmented reality device according to the position information and therotation information, and the augmentation device projects the adjustedvirtual image to a display of the augmented reality device, the adjustedvirtual image becomes a virtual extended screen, and the virtualextended screen and the physical mark are simultaneously displayed onthe display of the augmented reality device.
 2. The augmented realityscreen system of claim 1, wherein the processor executes a trackingalgorithm to detect the position information and the rotationinformation of the physical mark.
 3. The augmented reality screen systemof claim 1, wherein the processor uses a position projection algorithmto calculate target coordinates of each pixel of the virtual imageprojected to the display of the augmented reality device using theposition projection algorithm to adjust the virtual image, and projectsthe adjusted virtual image onto the display of the augmented realitydevice.
 4. The augmented reality screen system of claim 1, wherein theprocessor captures a field-of-view (FOV) range in a frame captured bythe camera, selects a reference point captures a first specific range ofthe field-of-view range in the frame, zooms in the first specific rangeto match the resolution of a physical display coupled to the host, movesthe reference point to target coordinates on the display of theaugmented reality device, captures a second specific range of the fieldof view in the frame, and matches a designated pixel of the secondspecific range to a designated position of the physical mark, so thatthe second specific area of the frame becomes a virtual extended screen,and the virtual extended screen and the physical mark are simultaneouslydisplayed on the display of the augmented reality device.
 5. Theaugmented reality screen system of claim 4, wherein the processoradjusts the second specific range according to the position informationand the rotation information, and regards the adjusted second specificrange as the virtual extended screen, the processor obtains an extensiondirection from the physical mark, the extension direction is transmittedto the augmented reality device, and the augmented reality devicedisplays the virtual extended screen on the display of the augmentedreality device according to the physical mark and the extensiondirection.
 6. An augmented reality screen display method, comprising:taking a physical mark through a camera of an augmented reality device;receiving the physical mark; determining position information androtation information of the physical mark; and fetching a virtual imagefrom a storage device through a processor of a host; wherein theprocessor transmits an adjusted virtual image to the augmented realitydevice according to the position information and the rotationinformation, and the augmentation device projects the adjusted virtualimage to a display of the augmented reality device, the adjusted virtualimage becomes a virtual extended screen, and the virtual extended screenand the physical mark are simultaneously displayed on the display of theaugmented reality device.
 7. The augmented reality screen display methodof claim 6, further comprising: executing a tracking algorithm to detectthe position information and the rotation information of the physicalmark.
 8. The augmented reality screen display method of claim 6, furthercomprising calculating target coordinates of each pixel of the virtualimage projected to the display of the augmented reality device using theposition projection algorithm to adjust the virtual image, andprojecting the adjusted virtual image onto the display of the augmentedreality device.
 9. The augmented reality screen display method of claim6, further comprising: capturing a field-of-view (FOV) range in a framecaptured by the camera; selecting a reference point from thefield-of-view range; moving the reference point to a boundary in theframe; capturing a first specific range of the field-of-view range inthe frame; zooming in the first specific range to match the resolutionof a physical display coupled to the host, and moving the referencepoint to target coordinates on the display of the augmented realitydevice; capturing a second specific range of the field of view in theframe; matching a designated pixel of the second specific range to adesignated position of the physical mark, so that the second specificarea of the frame becomes a virtual extended screen; and displaying thevirtual extended screen and the physical mark simultaneously on thedisplay of the augmented reality device.
 10. The augmented realityscreen display method of claim 9, further comprising: adjusting thesecond specific range according to the position information and therotation information, and regarding the adjusted second specific rangeas the virtual extended screen; obtaining an extension direction fromthe physical mark; and displaying the virtual extended screen on thedisplay of the augmented reality device according to the physical markand the extension direction.